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THE HACKBUSCH CONJECTURE ON TENSOR FORMATS 


WERONIKA BUCZYNSKA, JAROSLAW BUCZYNSKI, AND MATEUSZ MICHALEK 


Abstract. We prove a conjecture of W. Hackbusch about tensor network states related to 
a perfect binary tree and train track tree. Tensor network states are used to present seem¬ 
ingly complicated tensors in a relatively simple and efficient manner. Each such presentation 
is described by a binary tree and a collection of vector spaces, one for each vertex of the 
tree. A problem suggested by Wolfgang Hackbusch and Joseph Landsberg is to compare 
the complexities of encodings, if one presents the same tensor with respect to two different 
trees. We answer this question when the two trees are extremal cases: the most “spread” 
tree (perfect binary tree), and the “deepest” binary tree (train track tree). The corres¬ 
ponding tensor formats are called hierarchical formats (HE) and tensor train (TT) formats, 
respectively. 


Resume. Nous demontrons une conjecture de W. Hackbusch concernant des reseaux de 
tenseurs associes a certains arbres. Les reseaux de tenseurs sont utilises pour presenter des 
tenseurs apparemment compliques d’une maniere relativement simple et efficace. Chaque 
presentation d’un tenseur donne est decrite par un arbre binaire et une collection d’espaces 
vectoriels (un pour chaque sommet de I’arbre). Un probleme pose par Wolfgang Hackbusch 
et Joseph Landsberg est de comparer les complexites des codages lorsque Ton presente 
le meme tenseur via deux arbres differents. Nous repondons a cette question lorsque les 
deux arbres sont des cas extremes : I’arbre binaire parfait d’une part et I’arbre binaire le 
plus ’’profond” d’autre part. Les formats des tenseurs correspondants sont appeles format 
hierarchique (HE) et format train de tenseurs (TT), respectivement. 


1. Introduction 


In many sciences tensors encode sophisticated data or algorithms. It is therefore desirable 
that the tensors are represented efficiently. It is very mnch dependent on the particular 
problem, what does “efficiently” mean. One possibility is to study the rank of tensors, 
and express them as a sum of simple tensors, see |Landl2[ ICW82| IStra69| IBL13| IVC15| 
10013] . Another possibility, which we address in this article, is to use tensor formats, see 
also |Hackl21 IGHTTI lOseinQl lOsellll IHTTnl IVidan31 IVCnH] . 


A tensor format represents a tensor t G Vi(8)V2(8)---(8)I4bya sequence of linear subspaces 
in two-fold tensor products. The choice of a two-fold tensor products is determined by 
the combinatorics of a binary tree T. The idea is that in many practical situations, the 
dimensions of the linear spaces involved are much smaller than the dimension of Vi®V 2 ® 
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• • • <8) Vn- Thus, in these situations, tensor formats provide an efficient method of encoding 
the tensors. 

More precisely, for a binary tree T with n leaves we pick a vector space Vi for each leaf. 
For each vertex v we pick an integer f{v). We dehne the variety of tensor network states 
TNSxj C Vi ® • • • (8 W ffi fhe following way: t G TNSxj if and only if there exist linear 
subspaces of dimension at most f{v), such that: 

• Ui (Z Vi, ii V = i is one of the leaves, 

• C ® Uy^ whenever v is not a leaf and vi and V 2 are its children, 

• f G f/j, if n = r is the root of the tree. 
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leaf leaf leaf leaf 


node node 



leaf leaf leaf leaf 


Figure 1. Perfect binary tree of level 3 (with 8 = 2^ leaves). 
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Figure 2. Train track tree with 8 leaves. 

For an elementary example see, for instance. Figure 11.1 and Equation (11.1) in |Hackl2] . 
In other words, in order to represent t G TNS^j in the tensor format corresponding to T, 
we pick a linear subspace in each of the V), and then a seqnence of subspaces of the tensor 
product Uy C Uy^ 0 Uy^, where v is the parent of Vi and V 2 - Finally, we pick t G Fr, if 
n = r is the root. In Section |2] we present an eqnivalent dehnition not involving explicitly 
the subspaces Uy. 

In this article we compare tensor formats for two different trees: perfect binary tree H% 
of level k with 2^ leaves (Figure [T]), and train track tree TT (Figure |2]) with n leaves. In 
the literatnre, the corresponding tensor formats are called hierarchical tensor representation 
|Hackl21 Chapter 11] and TT format |Oselll] . |Hackl21 Chapter 12]. For simplicity of 
exposition most of the time we snppose that all integers f{v) are eqnal to a hxed integer r 
and moreover that diml^ > r. The variety of tensors of hierarchical format for a perfect 
binary tree H% of depth k (i.e. with n = 2^ leaves) is denoted HF{r,k) := TNSj/x.r- 
The variety of tensors of TT format for a tensor train tree TT with n leaves is denoted 
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JT{r,n) := TNSri,r- We answer the following question, communicated to us by Joseph 
Landsberg, and motivated by a conjecture of Wolfgang Hackbusch |Hackl21 Conj. 12.7]. 

Question 1.1. Given integers r and k, suppose dim 17 > r for each i. 

(1) What is the maximal integer r' such that HF{r,k) is not contained in any variety 
7T(r',2^) for any choice of ordering of the leaves of the tensor train tree? 

(2) What is the maximal r' such that TT{r, 2^) is not contained in any variety HF{r', k) 
for any choice of ordering of the leaves of the perfect binary tree? 

In particular, we prove the conjecture of Hackbusch. 

Theorem 1.2 (Conjecture of Hackbusch). The variety HF{r,k) is not contained in TTipr', 2^) 
for r' < for any ordering of leaves of T%. 

The bound on r' in the theorem is optimal. 

Proposition 1.3. The variety HF{r,k) is contained in TT{r'^^'^ ,2^) for the standard (left 
to right) ordering of leaves of both trees TT and H%. 

Moreover, we also prove an analogous statement for the the other containment. 

Proposition 1.4. The variety TT{r,2^) is contained in HF{r‘^,k) for the standard (left to 
right) ordering of leaves of both trees TT and H%. However, TT{r,2^) is not contained in 
HF{r', k) for any r' < for any reordering of the leaves of T^ 

Proposition 11.31 and the hrst part of Proposition 11.41 are proved in Section |3l Theorem 11.21 
and the second part of Proposition 11.41 are proved in Section |U 

Acknowledgements. The authors are grateful to the organisers and lecturers of the sum¬ 
mer school “Interdisciplinary approach to tensor decomposition” at Foundazione Bruno 
Kessler in Povo, Trento (14-18 July 2014). The article is a result of the problem communic¬ 
ated there by Joseph Landsberg, and solved in the stimulative atmosphere of the school. We 
thank Yang Qi for discussions and for explaining us the dimension formula (Proposition |22]). 
The article is written as a part of ” Computational complexity, generalised Waring type prob¬ 
lems and tensor decompositions”, a project within ’’Canaletto”, the executive program for 
scientihc and technological cooperation between Italy and Poland, 2013-2015. The paper is 
also a part of the activities of AGATES research group. 

2. Definitions 

Fix vector spaces Hi,..., 14 and a tree T with a root r and exactly n leaves. Throughout 
we assume that all trees are connected, and they are full binary trees, that is each vertex 
either has exactly two children (then it is called a node) or it has no children at all (hence 
it is called a leaf). Two main trees that we are interested in are the following. 

Definition 2.1 (The tree for hierarchical format, H%). The perfect binary tree H% of depth 
k is a tree with 2^^^ — 1 vertices of which 2^ are leaves, such that every leaf has the same 
number of ancestors (egual to k). Case k = 3 is illustrated on Figure\I\ This tree leads to 
hierarchical format of tensors, and its variety is denoted HF{r, k) := TNS/ix,r- 

Definition 2.2 (The tree for TT format, TT). The train track tree TT ofn leaves is a binary 
tree with 2n — 1 vertices, such that each node has at least one leaf as a child. Case n = 8 is 
illustrated on Figure [E This tree leads to TT format of tensors, and its variety is denoted 
TT{r,n) := TNSrx,^. 
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Definition 2.3 (Vertices 5J, nodes iJl, leaves £, J,). Let QJ, £ be respectively the set of 
vertices, nodes and leaves of the tree T. We have QJ = Ut U £. For any vertex w G QJ we 
denote by f v the subset of leaves of% that are descendants of v. 

The main object of our study is the variety of tensor network states 

TNSx,r C Vi 0 • • • (g) K. 

In order to describe it let us discuss tensor contractions. 


Definition 2.4 (Contraction l). We define the contraction map: 

l: Wf g {Wi g W 2 ) W 2 . 

For g G Wf and Wi® W 2 E Wi g W 2 we denote the image by g\-{wi g W 2 ) which is defined 
as g{wi)w 2 . We extend this map by linearity to whole Wi g IV 2 - 

We commence with recalling the dehnition of TNS^j from Introduction. 

Definition 2.5. Let / : TJ — ?■ N 6e any function. Fix a tree T and pick an order of the leaves 
£. The variety TNSjj of tensor network states associated to the tree T and the function f 
is the set of tensors t G Vi g • • • g 14; such that for each vertex v of % there exists a linear 
sub space of dimension at most f{y), and: 

• Uy G Vi, if V E SI is the i-th leaf, 

• Uv G g 17^2 whenever v is not a leaf and Vi and V 2 are its children, 

• t E U^, if V = X is the root of the tree. 

We underline that the variety of tensor network states and its embedding also depends on 
the choice of order of leaves, which is implicit in the notation TNSjj. We can eliminate the 
vector spaces from the dehnition by replacing them with rank conditions on contractions. 

Proposition 2.6. Let f, T and the order of leaves be as in Definition 1^.51 The variety 
TNS-xj is the locus of tensors t G 14 g • • • g 14; such that for any vertex v E'fO we have: 



Proof. Suppose t E TNS^j and pick the linear spaces as in Dehnition 12.51 Then t G 
Uv g > hence 


dim 



< dimf4 < f{v). 


If t G 14 g • • • g 14 is such that dim < f{v), then as the linear spaces f4 

we may take the images of contractions 


U, : = 



gr,. 

leiv 


□ 
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Thus set theoretically TNS-jj is dehned by flattenings corresponding to vertices. More 
precisely, for each v E V these are the (/(n) + l)-minors of the matrix with coefficients 
linearly depending ont eVi® ■ ■ ■ ®Vn representing the contraction map: 

(g)f";4(g)yz. 

We will frequently use the fact that the rank of this map is equal to the rank of the dual 
map: 

We have discussed the following dimension formula with Yang Qi, who has obtained it 
independently. For n G denote by vi and V 2 its children. To avoid redundant restrictions 
we always assume that: 

• for every i G {1,..., n} and for the Tth leaf I E £, we have /(/) < dim Vi, and 

• f{v) < f{vi)f{v 2 ) for all n G 01. 

Otherwise, if one of these restrictions fails, say f{v) > f{vi)f{v 2 ), then the variety of tensor 
network states is equal to one with f{v) replaced with f{vi)f{v 2 ). Moreover, if for any vertex 
V we have f{v) = 0, then TNSx,/ = {0}. Thus we suppose: 

• fi'^) ^ 0 for vertices v. 

Proposition 2.7 (also obtained independently by Yang Qi). With the assumption above, 
suppose diml/j = dj. Define the function /': QJ —j- N inductively: for the root x let f'{x) := 1. 
Then 

• f'{vi) := min(/'(n)/(n 2 ),/(o)) and 

• f'{v 2 ) := min(/'(n)/(ni),/(n 2 )). 

Then the dimension of the variety TNSx,/ equals: 

1 + - /'(«))/'(») + - /'('-))/'('()■ 

lies: 

If f is constant and equal to r then the dimension o/TNSx,/ is: 

nr‘^[r — 1) + + '^^{di — r)r. 

h&s: 

Moreover TNSxj is an irreducible algebraic variety. 

Proof. First let us prove that dimTNSx,/ is at least of dimension described above. Note that 
f\'a) < fi'a), f'{vi)f'{v 2 ) for any vertex v. 

Choose inductively, starting from leaves, general subspaces Ui^ (Z Vi, G 0 Uy^ of 
dimension f'{v) for all vertices v. For each n G 01 the possible subspaces Uy are parametrized 
by a Grassmannian Gr{f'{v), f'{vi)f'{v 2 )) of dimension {f'{vi)f{v 2 ) — f'{v))f{v). Analog¬ 
ously, for / G £ we obtain the Grassmannian Gr{f{li),di). Additionally, choose a general 
tensor f G f/ci 0 In order to prove the inequality, notice that t belongs to TNSx,/. 
Moreover, we claim that for any n G 01: 

Uy = {(^Vl)Wt. 
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This is true for the root. By induction, we have to show that If 

dim? 7 i ,2 < dim?7t,j the statement follows from the fact that contains a generic vector. 
Otherwise, /'(ui) = /(wi), hence < dimt/mdimf4. The statement follows, as the 

space Uy was spanned by dim Uy general vectors of Uy^ ( 8 ) Uy^. Hence, different choices of 
spaces provide different points t and the inequality 


dimTNSij > - /'(<'))/'(») +Ed' - 


dim Gr(/'(i;),C/„j^ (S)C/„2) 


dim Gr(f'{li),Vi) 


follows. 

To prove the other inequality, we claim that for any t G TNSjj 


dim{(^ViyL.t < f{v). 


The claim concludes the proof, as it shows that any t is determined by the choices of subspaces 
Uy of dimension f'{v) and an element of 

To show the claim, set Uy := ( 0 /^ 4 .^ ViY'-t- We prove inductively that dirnf/^ < f'{v). For 
the root the statement is obvious. Observe that dim Uy^ < dim Uy dim Uy ^, hence dim Uy-^ < 
f\v)f{v 2 ), and analogously for Uy^. This finishes the proof of the claim. □ 


For a tree T, we say that a subset of its leaves S' C £ is DOAD(T) (descendant or 
antidescendant for Tj if there exists a vertex u G 5J, such that S is equal to J, u or the 
complement £\ J, u. 

Lemma 2.8. Fix a tree T and a DOAD(T) subset S' C £. If t & TNSx,r for an integer 
constant r, then dim((( 3 );g 5 V5*)Lt) < r 

Proof. Since dim(((^jgj^^ = dim(((3);04^^ Vi*)L.t), the claim follows from Proposition l2.61 

□ 


3. Containments of varieties of tensor network states 

Again we fix vector spaces Vi,, Vn- In this section we want to compare the varieties 
of tensor network states for two different trees. We want them both to be contained in the 
same tensor product Vi ® ® Vn, and hence we need to match the ordering of the leaves. 

From now on, we will constantly assume, that the functions / giving the rank conditions are 
all constant, and that the dimensions dimVi are at least the value of /. 

We commence by proving certain containments of varieties of tensor network states. 

Lemma 3.1. Fix two binary trees T and T' of any shape with leaves labelled by the same 
set and pick a positive integer c G M. Suppose for any vertex v' G 2J', either f v' or the 
complement £\ f v' is a union of at most c sets St, where each Si is DOAD(T). Then 
TNSx,r c TNSx'.r- 

Proof. Let us fix a tensor t G TNS<j:,r- Consider any vertex v' of T'. We have to prove that: 
dim((^ Vi*)L.t < r^ or, equivalently, dim((^ < r^ 

l^iv' l^iv' 
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One of the sets I v' or £\ n' is a union of c DOAD(T) sets Si,... ,Sc- Thus it is enough 
to show: 

C 

dim((g)((g) V;*))Lf < 

i=i leSi 

which is guaranteed by Lemma [2.81 since dim((3)jg5. Vi*)L.t < r for each i. □ 

We need a simple lemma about binary representations of numbers. For any non-negative 
integer i, we dehne the function a{i) to be the number of digits equal to 1 in the binary 
representation of i. 

Lemma 3.2. Suppose k and j are non-negative integers satisfying j < 2^. Then either a{j) 
or a(2^ — j) is at most [|]. 

Proof. If j = 2^, then the claim is true. Otherwise, for i G {0,1,..., 2^ — l}, the function a 
satishes the following properties: 

• a{i) -|- q;(2^ — 1 — i) = k, 

• a{i -|- 1) < a{i) + 1. 

By the hrst property, either a{j) < | or q;(2^ — j — 1) < |. In the hrst case we are done. In 
the second case, we apply the other property to obtain q;( 2^ — j) < | -|- 1, which implies the 
claim. □ 


root 

/ \ 

node 8 

/ \ 

node 7 

/ \ 

node 6 

/ \ 

node 5 

/ \ 

node 4 

/ \ 

node 3 

/ \ 

1 2 

Figure 3. The standard (left to right) ordering of leaves on the perfect binary 
tree and the train track tree TT. 



Corollary 3.3. For any fc,r G N the following inclusion holds: 

HF{r,k) ClT(rrtl,2^), 

where the leaves in both trees are ordered from left to right, as shown in Figure 0. 
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Proof. Let 0 < j < 2^ be an integer. Consider the binary representation of the number j, 
and the number a{j) of digits 1 in the binary representation of j. Then the initial segment 
[1,... ,j] is a union of a{j) sets of the form J, n for n G H%. Analogously, the complement 
[j + 1,..., 2^] is a union of a(2^ — j) sets of such form. 

By Lemma 13.II it is enough to prove that each initial segment [1,..., j] or its complement 
[j + 1,..., 2^] can be represented as descendants of at most [|] vertices of H%. This follows 
by Lemma 13.21 □ 

Corollary 3.4. For any k,r eN the following inclusion holds: 

IT(r,2^) C HF{r\k), 

where the leaves in both trees are ordered from left to right, as shown in Figure 0. 

Proof. Let us £x a vertex n of i/T. Notice that J, n is an interval, say [a,h\. Its complement 
is the union of [l,a — 1] and the complement of [1,&], i.e. it is a union of two DOAD(TT) 
sets. The conclusion follows by Lemma 13.11 □ 


4. Hackbusch Conjecture 


Our aim is to prove that the bounds in Corollaries 13.31 and 13.41 are optimal, even if we allow 
arbitrary ordering of leaves. For the purpose of induction argument, we need Lemma 14.11 
The idea is that from tensors, which have large contractions on two disjoint subtrees we can 
construct tensors with large contractions on the whole tree. So for tree T and two vertices 
r',r" G 2J, denote by T' and T" the two subtrees of T with roots r' and r", and with leaves 
i x' and f r", respectively, see Figure 01 

In the proofs in this section, for the clarity and brevity of notation we will often write tensor 
products in a different order than originally. For instance, in Equation fl4.ip below there are 
two disjoint sets of indices j, F, j, r" C il, two tensors t' G ^ ^ and 

vectors xi E Vi. To be formally correct, we should write: 


t ■.= t' ® t” 


xi E 


V, 


V, 




Uejr' 


Uejr" 


Instead, we skip the redundant middle term ( <S>i£ix' 





Lemma 4.1. Fix any subset A C £, of leaves of a tree T, and choose two disjoint subtrees 
and T" as above. Let A' = An j, x' and A" = An j, x" , and choose t' E TNSy^r o,nd 
t" g TNS 3 :",r-- Set q' := dim Vj)* lF) and q" := dim Vj)* lF') . Then there 

exists a tensor t E TNSx,r such that 


dim 



= Qq 


n 


Proof. Pick any non-zero vectors Xi E Vi for each I FU j, F'. Then set 
(4.1) t:=F(8)F'(8) xi eVi® ■ ■ ■ ®Vn. 

We claim such t satisfies the required properties. 
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root 



Figure 4. Tree T with two subtrees T' and T" determined by vertices x' and x". 
To see that t G TNS‘j:,r, pick any vertex u G TT; we have to show: 



If V is in T', then the required dimension bound is provided by the condition t' G TNSx',r, 
since t = t' ® x, with x G ^i- Similarly, if v is in T". Otherwise, the contraction of t 

is always 1 dimensional. 

To see dim (((S)/gA ct) = q'q", we split the contraction into three parts: 



In the proof of Conjecture of Hackbusch we will use the above lemma for the tree H% 
and the corresponding variety of tensor network states HF{k,r). The tree iJT contains 
four subtrees Ti,T 2 ,T 3 ,T 4 , where the root of Tj is Xi and the leaves of Tj are j, = 
— 1) + 1,... as illustrated in Figure [5l For each of the trees T* we can 

also consider the variety of tensor network states TNS 3 :i,r, with the underlying vector spaces 
Vi for I G {2^-2(i - 1) + 1,, 2’^-H}. 

Lemma 4.2. Let us fix any subset A of leaves of the tree FIT. Suppose that: 

(1) for one of the four trees Ti, T 2 , T 3 , T 4 there exists tensor t” G TNS.Xi,rj such that 

dim( 

iGAniti 

(2) there exists another subtree T' of H% with a root x' such that f Ffl j, tj = 0 and 
An j, F 7 ^ 0 and fx'^^A, i.e. the set of leaves of the tree T' and its complement have 
non-empty intersection with the set A and it is disjoint from the set of leaves of%i. 
(If we set T" = T*, then this is illustrated on Figure\^) 
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root 




Figure 5. Four subtrees Ti, ‘I 2 , ‘^ 3 , and ‘I 4 of H%. We denote vertices ti, 
^ 2 , ^ 3 , 114 , vi, and V 2 as illustrated on the figure. 


Then there exists a tensor t G HF{k,r) such that: 

dim((^ F;*)Lf > 

l^A 


Proof. It is a direct application of Lemma 14.11 with T" = 
existence of t" is given by the hypothesis of the lemma. 
TNSx,,.. 


%i, and q' > r, q" > The 

As t' we take a general tensor in 

□ 


We conclude with the proof of Hackbusch conjecture. 


Theorem 4.3 (Hackbusch conjecture). For any k > 1, r > 2 the variety HF{r,k) is not 
contained in any of the varieties 7T(rl^2^ — 1, 2^) for any reordering of the leaves ofT%. 


Proof. The ordering of leaves of the tree TT will be encoded by a permutation a G S'2fc, 
where S 2 k is the permutation group of 2^ elements, see Figure [6l Without loss of generality, 
for the clarity of notation, we may suppose that (t(1 ) = 1. 

The statement of the theorem is equivalent to the following: for any permutation a G S'2fe 
there exists a tensor t G HF{r,k) and a number 1 < j < 2^ such that 

j 

(4.2) dim((g) 

The proof is inductive on k. If A: = 0, then there is nothing to do. For k = 1 the 
trees H% and TT are both equal to a binary tree with two leaves both connected to the 
root of the tree. The dimension bounds are r for HF and r — 1 for TT, so the statement is 
HF{r, 1) ^ TT{r — 1, 2) and amounts to an easy observation that a generic map has maximal 
rank. 
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root root 



1 a(2) 


Figure 6 . The standard ordering of leaves on the perfect binary tree H% and 
an arbitrary ordering of the leaves on the train track tree TT. The order is 
encoded by a permutation a G S2k. Without loss of generality we may assume 
that (t(1 ) = 1. 


Pick four subtrees Ti, T 2 , T 3 , T 4 of the tree iJT as in Figure [5l The permutation a induces 
an ordering ... ,a{n) of the leaves of iJT, hence also of leaves of each T*. 

We consider the sequences of leaves Aj := {(j(l) = 1, (t(2), ..., a{j)} starting from j = I 
and increasing j. Some of the leaves corresponding to the elements of this sequence will 
belong Ti, the others to T 2 etc. We keep increasing j, and we pause for a moment at the 
hrst instance j = ji, when one of the four trees %a has enough leaves to satisfy the induction 
assumption. That is, set ji to be the smallest number such that for some a G {1, 2, 3,4} we 
have: 

dim( (g) F/)Lt" > 

ieAjj^nixa 

for some t" G TNSx^^^. Using the inductive assumption, such ji exists. 

Suppose there exists a leaf / G which is outside of Ta, say I is a leaf of %b- Note not 
all leaves of are in as this would contradict minimality of ji. Thus, by Lemma [4.21 
the dimension bound in fl4.2p is satished. 

Hence we may assume Aj^ is contained in the set of leaves of Ta. In particular, Ta = Ti, 
since (t(1) = 1, and the hrst leaf is in Tq. Now we resume increasing j, until for some 
j = 42 we obtain another subtree Tb 7 ^ Ti, such that the leaves of Aj^n I satisfy induction 
assumption: 

(4.3) dim( (g) V*)L.t" > 

for some t" G TNS‘Xi,,r- Similarly as before, if Aj^ contains a leaf from one of the subtrees 
other than Ti or Tj,, then by Lemma 14.21 the dimension bound (14. 2 h is satished. The same 
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happens if not all leaves from Ti are contained in Aj^. Also, if 6 7 ^ 2 , then as T' in Lemma 
we may take the tree, whose root is vi G QJ, the son of r, and the father of ti and r 2 . 

Denote by V 2 the other son r, and the father of ts and r 4 . 

From now on we snppose that 6 = 2 and A = Aj^ contains all the leaves of Ti, some of the 
leaves of T 2 , and no leaf of T 3 or T 4 . We will construct tensor t satisfying fl4.2p for A = Aj^ as 
t := u®t'\ where Vi is the tensor from fl4.3p . and u G is 

chosen as follows. For each n G pick a linear subspace of dimension r as in Definition l2.5l 
Then let u be general. Hence 


t e D,, ® ( 0^ Id ) ® f/,. 


= u.- 


vA®\u, 


i&Aj^ nir2 


V2 

i64.C2\Aj2 


To show fl4.2p for A = Aj^, we must consider the dimension of the contraction: 




XI '<y Yy y] l(m ® t”) 

iGAj^n^V2 y 


(Ux.^u) 


V Lt" 


= Uy. 


,i£Ajy n 4 ,t 2 


has dimension at least r' ^ 


rfi-i 


Thus the dimension of the contraction is at least which completes the proof of the 
theorem. □ 


Naively, one could expect, that the dimensions of contractions are as large as possible. 
More precisely, for any subset A C ii let h{A) be defined as: 

h{A) := min < a : dui,..., Uq G TT, such that A = J, Uj 

[ i=i 

Now take a general tensor t G HF{r,k) one could expect dim((^;g^ ld*Lt) to be equal to 
j,mm(h(A),h(£\A))_ following example shows this is false. 

Example 4.4. Consider k = 3 and r = 2. For a generic tensor t G HF{r,k) we have 
dim(fod (g) V 2 * 0 V 3 * 0 V^i-t = 5 < 8 . 

Remark 4.5. It is interesting to see which contraction shows that HF{r, k) ^ 1, 2^) 

with the same ordering of leaves. One can show that for k odd it can be given by (S)°=i Id* 
where the binary representation of a is given by 1010... 10 + 1 where the number of digits 
eguals k — 1. 

Proposition 4.6. For any k >3, r >2 the variety TT{r, 2^) is not contained in any of the 
varieties HF{r‘^ — 1, k) for any matching of the leaves of the trees TT and H%. 

Proof. Let n = 2^ be the number of leaves of TT and iLT. Pick a matching of the leaves 
determined by a permutation a as in Figured A cherry in the tree FfT is a pair of leaves 
{2i — 1, 2i) for some i G |l, 2,..., 2^“^}. Since k > 3, there exists a cherry (2i — 1, 2i) such 
that 1 < a{2i — 1), a(2i) < n. That is, the leaves in TT corresponding to the cherry are not 
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among the extremal leaves 1 or n. Denote a := cr“^(l) and b := a~^{n), i.e. a and b are the 
leaves of hTT corresponding to the extremal leaves of TT. 

We claim that there exists a tensor t G IT(r, 2^) such that dim (V 2 *_i <S) D 2 *Lt) = In 
particular, t ^ HF{r^ — l,k). Explicitly, pick four r dimensional subspaces 

Ua C 14, Ua C 14, U2i-l C V2i-1, Dsi C l^i, 

and vectors xi G Vi for all I ^ {a,b,2i — l,2i}. To £x the notation, we assume that 
a{2i — 1) < o'{2i) (otherwise, swap the roles of cr(2i — 1) and a{2i)). Let yi EUa® U^( 2 i-i) 
and 1/2 G Ufj{ 2 i) ® Ui, be general vectors. 

We dehne 

t-=yi®y2 ® xie Id. 

l^{a,b,2i-l,2i} 

The following calculation proves the claim: 

dim {V 2 i_i ® = dim j (DsVili/i) 0 (f/ 2 Vl/ 2 ) ® xi 

y l^{a,b,2i-l,2i} 

= dim I f/a 0 Dfe (g) xi 

y l<^{a,b,2i-l,2i} 

= dim {Ua ® Ub) = r^. 

It is a straightforward check that t G TT{r, 2^). □ 


[BL13] 

[CW82] 

[GHll] 

[Hackl2] 

[Landl2] 

[0013] 

[Osel09] 

[Oselll] 

[OTIO] 

[Stra69] 

[VC06] 

[VC15] 

[Vida03] 


References 

Jaroslaw Buczynski and J.M. Landsberg. Ranks of tensors and a generalization of secant varieties. 
Linear Algebra AppL, 438(2):668-689, 2013. 

D. Coppersmith and S. Winograd. On the asymptotic complexity of matrix multiplication. SIAM 
J. Comput, ll(3):472-492, 1982. 

Lars Grasedyck and Wolfgang Hackbusch. An introduction to hierarchical {%-) rank and TT-rank 
of tensors with examples. Comput. Methods Appl. Math., ll(3):291-304, 2011. 

Wolfgang Hackbusch. Tensor spaces and numerical tensor calculus, volume 42 of Springer Series 
in Computational Mathematics. Springer, Heidelberg, 2012. 

J. M. Landsberg. Tensors: geometry and applications, volume 128 of Graduate Studies in Math¬ 
ematics. American Mathematical Society, Providence, Rl, 2012. 

Luke Ceding and Giorgio Ottaviani. Eigenvectors of tensors and algorithms for Waring decompos¬ 
ition. J. Symbolic Comput., 54:9-35, 2013. 

1. V. Oseledets. On a new tensor decomposition. Dokl. Akad. Nauk, 427(2):168-169, 2009. 

1. V. Oseledets. Tensor-train decomposition. SIAM J. Sci. Comput, 33(5):2295-2317, 2011. 

Ivan Oseledets and Eugene Tyrtyshnikov. TT-cross approximation for multidimensional arrays. 
Linear Algebra Appl., 432(l):70-88, 2010. 

Volker Strassen. Gaussian elimination is not optimal. Numer. Math., 13:354-356, 1969. 

Erank Verstraete and J Ignacio Cirac. Matrix product states represent ground states faithfully. 
Physical Review B, 73(9):094423, 2006. 

Pter Vrana and Matthias Christandl. Asymptotic entanglement transformation between w and ghz 
states. Journal of Mathematical Physics, 56(2), 2015. 

Guifre Vidal. Efficient classical simulation of slightly entangled quantum computations. Physical 
Review Letters, 91(14):147902, 2003. 


14 


W. BUCZYNSKA, J. BUCZYNSKI, AND M. MICHALEK 


Weronika Buczynska, Institute of Mathematics of the Polish Academy of Sciences, ul. 
Sniadeckich 8, 00-656 Warszawa, Poland 
E-mail address: wkrych@mimuw.edu.pl 

Jaroslaw Buczynski, Faculty of Mathematics, Computer Science and Mechanics, Univer¬ 
sity OF Warsaw, ul. Banacha 2, 02-097 Warszawa, Poland, and Institute of Mathematics of 
THE Polish Academy of Sciences, ul. Sniadeckich 8, 00-656 Warszawa, Poland 
E-mail address: jabu@mimuw.edu.pl 

Mateusz Michalek, Simons Institute for the Theory of Computing, 121 Calvin Lab 2190, 
UC Berkeley, CA 94720, USA, and Institute of Mathematics of the Polish Academy of 
Sciences, ul. Sniadeckich 8, 00-656 Warszawa, Poland 
E-mail address: wajcha2@poczta.onet.pl 


